Return of the Nuggets – AI Engineering

Charles F. Vardeman II

Center for Research Computing, University of Notre Dame

2023-11-17

This is all Peter’s falt!

Peter: How do we prompt better?

Prompting in the context of AI Engineering

AI Engineering as a Practice?

AI Engineering Summit

AI Engineering Summit – Youtube

LLMOps Engineering

LLMOps Engineering

LLM Engineering – Prompt Engineering, RAG Engineering, Fine Tuning Engineering.

LLMOps – Cognitive Agents

A Caution: Outward facing Data Fabric vs Inward Facing…

  • We don’t want to be engineering data silos!
  • With Agents, the “World Wide Web” is a Data Fabric!
  • We want to expose some information as Distributed Knowledge Graphs!

Data Fabrics are going to be used as Data Engines!

Twitter: Andrej Karpathy

How to Prompt?

How to Prompt Engineer…

Prompting Guide

OpenAI Cookbook

Important: Prompt Structure Performance Changes with Model!

Prompt Testing?

Retrevial Augmented Generation

Unit Testing of LLMs

Prompt Engineering is about adding context!

KGs for Context

KGs for Context

Information Extraction for RAG (Tool Use)

Prompting Patterns for RAG – Planning and Action

Training and Fine Tuning

Textbooks are all you need II: phi-1.5

Maybe we need more than Textbooks?

A “Curriculum” for Logic?

A “Curriculum” for Logic?